Update to arrow/parquet `58.1.0` by alamb · Pull Request #21044 · apache/datafusion

alamb · 2026-03-18T20:54:28Z

~~Note this is a draft PR until I have completed the release of arrow 58~~

Which issue does this PR close?

Rationale for this change

Update to latest release of arrow

What changes are included in this PR?

Are these changes tested?

By CI

I also manually ran

cargo test --test sqllogictests

And it passes (vs failing with asserts on main):

...

Are there any user-facing changes?

alamb · 2026-03-24T20:26:31Z

run benchmarks

adriangbot · 2026-03-24T20:29:17Z

🤖 Benchmark running (GKE) | trigger
Linux bench-c4121145036-520-s865k 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing alamb/update_arrow_58.1.0 (93e0202) to 10fae81 (merge-base) diff using: clickbench_partitioned
Results will be posted here when complete

adriangbot · 2026-03-24T20:29:19Z

🤖 Benchmark running (GKE) | trigger
Linux bench-c4121145036-522-lb27f 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing alamb/update_arrow_58.1.0 (93e0202) to 10fae81 (merge-base) diff using: tpch
Results will be posted here when complete

adriangbot · 2026-03-24T20:29:19Z

🤖 Benchmark running (GKE) | trigger
Linux bench-c4121145036-521-2fc77 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing alamb/update_arrow_58.1.0 (93e0202) to 10fae81 (merge-base) diff using: tpcds
Results will be posted here when complete

adriangbot · 2026-03-24T20:43:59Z

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and alamb_update_arrow_58.1.0
--------------------
Benchmark tpch_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃                           HEAD ┃      alamb_update_arrow_58.1.0 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │ 44.98 / 45.65 ±0.86 / 47.33 ms │ 45.10 / 45.86 ±0.94 / 47.70 ms │     no change │
│ QQuery 2  │ 20.70 / 21.61 ±0.94 / 23.31 ms │ 20.82 / 21.34 ±0.72 / 22.74 ms │     no change │
│ QQuery 3  │ 31.36 / 31.86 ±0.60 / 33.03 ms │ 31.39 / 31.72 ±0.31 / 32.32 ms │     no change │
│ QQuery 4  │ 21.11 / 21.70 ±0.32 / 22.06 ms │ 20.26 / 22.10 ±1.95 / 25.65 ms │     no change │
│ QQuery 5  │ 47.42 / 49.21 ±1.54 / 51.23 ms │ 47.25 / 49.26 ±1.69 / 51.59 ms │     no change │
│ QQuery 6  │ 16.98 / 17.21 ±0.23 / 17.54 ms │ 17.03 / 17.28 ±0.25 / 17.77 ms │     no change │
│ QQuery 7  │ 54.44 / 55.50 ±1.36 / 58.11 ms │ 53.11 / 54.83 ±1.56 / 57.13 ms │     no change │
│ QQuery 8  │ 47.40 / 48.06 ±0.34 / 48.29 ms │ 47.84 / 48.15 ±0.28 / 48.61 ms │     no change │
│ QQuery 9  │ 53.87 / 54.64 ±0.98 / 56.52 ms │ 54.04 / 55.13 ±0.69 / 55.98 ms │     no change │
│ QQuery 10 │ 71.04 / 72.23 ±1.42 / 74.90 ms │ 71.10 / 71.52 ±0.29 / 71.86 ms │     no change │
│ QQuery 11 │ 13.53 / 14.02 ±0.62 / 15.21 ms │ 13.50 / 14.05 ±0.53 / 14.94 ms │     no change │
│ QQuery 12 │ 27.29 / 27.92 ±0.69 / 29.26 ms │ 27.52 / 27.92 ±0.30 / 28.41 ms │     no change │
│ QQuery 13 │ 38.76 / 39.54 ±0.56 / 40.47 ms │ 38.11 / 40.19 ±1.50 / 42.59 ms │     no change │
│ QQuery 14 │ 28.41 / 28.67 ±0.26 / 29.17 ms │ 28.48 / 28.79 ±0.26 / 29.19 ms │     no change │
│ QQuery 15 │ 33.68 / 34.26 ±0.59 / 35.29 ms │ 33.45 / 34.07 ±0.70 / 35.37 ms │     no change │
│ QQuery 16 │ 16.04 / 16.53 ±0.52 / 17.16 ms │ 15.60 / 16.02 ±0.22 / 16.24 ms │     no change │
│ QQuery 17 │ 73.41 / 74.70 ±0.92 / 76.14 ms │ 72.75 / 73.37 ±0.69 / 74.43 ms │     no change │
│ QQuery 18 │ 80.96 / 81.68 ±0.93 / 83.46 ms │ 75.93 / 77.51 ±1.10 / 78.82 ms │ +1.05x faster │
│ QQuery 19 │ 37.96 / 38.39 ±0.44 / 38.96 ms │ 37.15 / 37.71 ±0.37 / 38.31 ms │     no change │
│ QQuery 20 │ 40.78 / 41.60 ±0.73 / 42.79 ms │ 39.63 / 40.38 ±0.72 / 41.53 ms │     no change │
│ QQuery 21 │ 65.72 / 68.43 ±2.39 / 72.01 ms │ 63.34 / 65.11 ±1.15 / 66.70 ms │     no change │
│ QQuery 22 │ 18.60 / 18.79 ±0.12 / 18.94 ms │ 17.24 / 17.85 ±0.50 / 18.76 ms │     no change │
└───────────┴────────────────────────────────┴────────────────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━┓
┃ Benchmark Summary                        ┃          ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━┩
│ Total Time (HEAD)                        │ 902.19ms │
│ Total Time (alamb_update_arrow_58.1.0)   │ 890.15ms │
│ Average Time (HEAD)                      │  41.01ms │
│ Average Time (alamb_update_arrow_58.1.0) │  40.46ms │
│ Queries Faster                           │        1 │
│ Queries Slower                           │        0 │
│ Queries with No Change                   │       21 │
│ Queries with Failure                     │        0 │
└──────────────────────────────────────────┴──────────┘

Resource Usage

tpch — base (merge-base)

Metric	Value
Wall time	4.8s
Peak memory	4.2 GiB
Avg memory	3.6 GiB
CPU user	33.4s
CPU sys	2.9s
Disk read	0 B
Disk write	144.0 KiB

tpch — branch

Metric	Value
Wall time	4.7s
Peak memory	4.1 GiB
Avg memory	3.6 GiB
CPU user	33.2s
CPU sys	2.8s
Disk read	0 B
Disk write	128.0 KiB

mbutrovich

LGTM pending CI.

adriangbot · 2026-03-24T20:49:57Z

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and alamb_update_arrow_58.1.0
--------------------
Benchmark tpcds_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃                                     HEAD ┃                alamb_update_arrow_58.1.0 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │           43.38 / 44.50 ±0.81 / 45.65 ms │           43.58 / 44.37 ±0.65 / 45.37 ms │     no change │
│ QQuery 2  │        147.86 / 148.17 ±0.37 / 148.88 ms │        144.93 / 146.23 ±0.75 / 146.91 ms │     no change │
│ QQuery 3  │        113.78 / 115.01 ±0.67 / 115.77 ms │        113.49 / 114.84 ±0.75 / 115.82 ms │     no change │
│ QQuery 4  │    1400.24 / 1447.08 ±25.99 / 1475.45 ms │    1382.05 / 1406.29 ±22.46 / 1443.71 ms │     no change │
│ QQuery 5  │        171.81 / 174.56 ±1.68 / 176.92 ms │        173.01 / 175.18 ±1.26 / 176.49 ms │     no change │
│ QQuery 6  │    1012.29 / 1050.24 ±22.80 / 1079.05 ms │    1056.44 / 1089.35 ±25.15 / 1121.05 ms │     no change │
│ QQuery 7  │        356.23 / 359.33 ±2.74 / 363.37 ms │        357.46 / 359.02 ±1.79 / 361.42 ms │     no change │
│ QQuery 8  │        115.06 / 116.88 ±1.23 / 118.51 ms │        116.02 / 117.72 ±0.96 / 118.73 ms │     no change │
│ QQuery 9  │        101.77 / 103.90 ±1.95 / 106.40 ms │        101.66 / 105.36 ±2.41 / 108.66 ms │     no change │
│ QQuery 10 │        106.94 / 108.22 ±0.89 / 109.47 ms │        108.20 / 109.37 ±0.93 / 110.83 ms │     no change │
│ QQuery 11 │     991.28 / 1004.25 ±10.64 / 1018.23 ms │      973.50 / 997.04 ±13.58 / 1013.09 ms │     no change │
│ QQuery 12 │           48.19 / 49.58 ±1.11 / 51.37 ms │           45.87 / 46.59 ±0.77 / 47.53 ms │ +1.06x faster │
│ QQuery 13 │        406.81 / 412.00 ±2.79 / 415.18 ms │        399.33 / 405.91 ±4.88 / 412.73 ms │     no change │
│ QQuery 14 │     1024.62 / 1030.14 ±5.37 / 1038.75 ms │     1027.37 / 1031.65 ±2.57 / 1034.97 ms │     no change │
│ QQuery 15 │           17.05 / 17.79 ±0.76 / 19.03 ms │           16.33 / 17.35 ±0.98 / 19.09 ms │     no change │
│ QQuery 16 │           41.70 / 42.44 ±1.23 / 44.90 ms │           40.86 / 42.07 ±0.67 / 42.78 ms │     no change │
│ QQuery 17 │        243.39 / 244.80 ±1.38 / 246.97 ms │        242.23 / 245.72 ±2.70 / 250.39 ms │     no change │
│ QQuery 18 │        131.03 / 132.63 ±1.24 / 134.73 ms │        130.53 / 131.52 ±0.88 / 132.91 ms │     no change │
│ QQuery 19 │        157.89 / 158.67 ±0.55 / 159.54 ms │        156.88 / 157.97 ±0.92 / 159.48 ms │     no change │
│ QQuery 20 │           13.71 / 14.72 ±0.90 / 16.24 ms │           14.03 / 14.49 ±0.33 / 15.03 ms │     no change │
│ QQuery 21 │           19.64 / 20.19 ±0.45 / 20.98 ms │           19.95 / 20.22 ±0.24 / 20.58 ms │     no change │
│ QQuery 22 │        493.36 / 496.54 ±3.61 / 503.45 ms │       490.96 / 502.21 ±11.25 / 523.31 ms │     no change │
│ QQuery 23 │        917.83 / 930.74 ±9.74 / 945.55 ms │        917.23 / 927.37 ±6.29 / 933.36 ms │     no change │
│ QQuery 24 │        419.82 / 424.03 ±5.32 / 433.96 ms │        423.35 / 426.44 ±2.11 / 428.64 ms │     no change │
│ QQuery 25 │        354.30 / 356.93 ±1.51 / 358.97 ms │        358.83 / 363.57 ±2.49 / 365.88 ms │     no change │
│ QQuery 26 │           83.46 / 84.19 ±0.76 / 85.51 ms │           82.16 / 84.56 ±1.62 / 86.82 ms │     no change │
│ QQuery 27 │        349.51 / 354.37 ±4.00 / 359.11 ms │        351.89 / 354.95 ±3.20 / 360.48 ms │     no change │
│ QQuery 28 │        148.93 / 151.13 ±1.63 / 153.30 ms │        150.76 / 151.16 ±0.49 / 152.07 ms │     no change │
│ QQuery 29 │        302.41 / 304.13 ±1.92 / 307.46 ms │        302.70 / 304.75 ±3.32 / 311.35 ms │     no change │
│ QQuery 30 │           43.11 / 44.39 ±1.31 / 46.25 ms │           45.34 / 46.57 ±1.29 / 48.84 ms │     no change │
│ QQuery 31 │        169.86 / 172.78 ±1.76 / 174.67 ms │        171.50 / 177.67 ±6.46 / 189.81 ms │     no change │
│ QQuery 32 │           57.83 / 58.75 ±0.61 / 59.63 ms │           57.76 / 59.86 ±1.53 / 61.75 ms │     no change │
│ QQuery 33 │        141.00 / 143.63 ±1.38 / 144.74 ms │        140.96 / 143.05 ±1.11 / 144.21 ms │     no change │
│ QQuery 34 │        107.71 / 109.07 ±0.69 / 109.68 ms │        107.80 / 108.56 ±0.68 / 109.63 ms │     no change │
│ QQuery 35 │        108.30 / 110.53 ±1.47 / 112.37 ms │        109.34 / 110.33 ±0.76 / 111.22 ms │     no change │
│ QQuery 36 │        211.42 / 221.13 ±5.34 / 225.94 ms │        217.09 / 223.30 ±3.67 / 228.15 ms │     no change │
│ QQuery 37 │        178.00 / 181.28 ±1.82 / 183.59 ms │        180.49 / 183.94 ±3.24 / 188.55 ms │     no change │
│ QQuery 38 │           86.83 / 89.65 ±2.70 / 94.32 ms │           86.63 / 89.94 ±3.51 / 96.57 ms │     no change │
│ QQuery 39 │        128.55 / 131.37 ±2.23 / 135.04 ms │        126.72 / 129.53 ±2.35 / 132.28 ms │     no change │
│ QQuery 40 │        113.47 / 118.70 ±5.79 / 129.61 ms │        115.22 / 121.52 ±8.12 / 137.54 ms │     no change │
│ QQuery 41 │           14.87 / 15.88 ±0.92 / 17.25 ms │           15.47 / 16.22 ±0.51 / 16.83 ms │     no change │
│ QQuery 42 │        107.30 / 109.66 ±1.84 / 111.77 ms │        108.11 / 109.49 ±0.84 / 110.44 ms │     no change │
│ QQuery 43 │           83.38 / 84.22 ±0.75 / 85.56 ms │           83.87 / 84.43 ±0.77 / 85.95 ms │     no change │
│ QQuery 44 │           11.68 / 12.26 ±0.41 / 12.78 ms │           11.43 / 11.81 ±0.22 / 12.11 ms │     no change │
│ QQuery 45 │           53.26 / 54.34 ±1.08 / 56.16 ms │           53.33 / 54.61 ±0.96 / 56.17 ms │     no change │
│ QQuery 46 │        237.35 / 239.48 ±1.53 / 241.95 ms │        239.39 / 242.72 ±2.34 / 245.99 ms │     no change │
│ QQuery 47 │        745.70 / 753.41 ±5.04 / 760.70 ms │       753.26 / 767.39 ±11.63 / 781.07 ms │     no change │
│ QQuery 48 │        288.54 / 294.49 ±4.95 / 303.37 ms │        287.52 / 290.53 ±3.03 / 294.90 ms │     no change │
│ QQuery 49 │        254.51 / 257.38 ±1.82 / 260.19 ms │        255.55 / 258.40 ±2.17 / 260.81 ms │     no change │
│ QQuery 50 │        232.56 / 238.89 ±4.25 / 243.96 ms │        235.82 / 241.69 ±4.42 / 248.79 ms │     no change │
│ QQuery 51 │        182.16 / 184.53 ±1.90 / 186.80 ms │        184.27 / 186.57 ±1.88 / 190.00 ms │     no change │
│ QQuery 52 │        108.04 / 109.99 ±1.44 / 112.17 ms │        107.59 / 108.79 ±0.64 / 109.44 ms │     no change │
│ QQuery 53 │        102.09 / 103.15 ±0.68 / 104.17 ms │        104.27 / 105.44 ±0.95 / 107.14 ms │     no change │
│ QQuery 54 │        148.20 / 149.89 ±1.23 / 151.23 ms │        148.63 / 150.56 ±1.78 / 153.38 ms │     no change │
│ QQuery 55 │        108.05 / 109.24 ±1.06 / 110.50 ms │        106.68 / 109.10 ±1.69 / 111.90 ms │     no change │
│ QQuery 56 │        140.86 / 142.87 ±2.14 / 147.01 ms │        142.25 / 144.75 ±1.55 / 146.50 ms │     no change │
│ QQuery 57 │        175.34 / 178.32 ±2.41 / 181.68 ms │        176.35 / 177.78 ±0.88 / 179.11 ms │     no change │
│ QQuery 58 │       306.24 / 328.52 ±19.09 / 359.00 ms │        290.28 / 298.02 ±6.43 / 306.14 ms │ +1.10x faster │
│ QQuery 59 │        200.95 / 203.56 ±2.42 / 207.22 ms │        200.29 / 201.68 ±1.63 / 204.58 ms │     no change │
│ QQuery 60 │        142.86 / 144.84 ±1.64 / 147.31 ms │        144.16 / 145.83 ±1.94 / 148.88 ms │     no change │
│ QQuery 61 │        172.64 / 174.13 ±1.19 / 176.01 ms │        173.59 / 174.84 ±0.99 / 175.87 ms │     no change │
│ QQuery 62 │       911.66 / 939.27 ±16.61 / 959.28 ms │       901.49 / 949.21 ±29.34 / 985.26 ms │     no change │
│ QQuery 63 │        105.88 / 108.61 ±2.82 / 113.72 ms │        105.78 / 108.08 ±2.67 / 112.31 ms │     no change │
│ QQuery 64 │        706.03 / 712.62 ±3.78 / 717.78 ms │        717.27 / 720.49 ±2.31 / 723.48 ms │     no change │
│ QQuery 65 │        256.17 / 259.14 ±1.65 / 260.76 ms │        256.66 / 261.78 ±3.70 / 268.23 ms │     no change │
│ QQuery 66 │       256.50 / 268.90 ±18.40 / 304.92 ms │        243.50 / 252.77 ±6.96 / 260.98 ms │ +1.06x faster │
│ QQuery 67 │        314.50 / 325.63 ±7.51 / 333.58 ms │        318.28 / 325.70 ±3.71 / 327.61 ms │     no change │
│ QQuery 68 │        285.75 / 290.25 ±2.53 / 293.56 ms │        283.37 / 288.56 ±3.36 / 291.79 ms │     no change │
│ QQuery 69 │        102.78 / 105.62 ±1.87 / 108.41 ms │        103.79 / 105.98 ±1.65 / 108.68 ms │     no change │
│ QQuery 70 │       342.22 / 362.44 ±14.57 / 387.47 ms │       333.55 / 345.33 ±11.20 / 366.16 ms │     no change │
│ QQuery 71 │        133.83 / 135.82 ±2.06 / 139.71 ms │        134.61 / 136.97 ±2.17 / 140.52 ms │     no change │
│ QQuery 72 │       726.80 / 739.84 ±12.97 / 761.53 ms │       722.85 / 736.82 ±11.66 / 750.34 ms │     no change │
│ QQuery 73 │        104.30 / 105.36 ±1.04 / 107.27 ms │        104.43 / 105.81 ±1.21 / 107.95 ms │     no change │
│ QQuery 74 │        617.36 / 629.63 ±7.00 / 636.12 ms │        624.80 / 630.63 ±7.16 / 644.13 ms │     no change │
│ QQuery 75 │        276.72 / 279.98 ±2.51 / 284.24 ms │        278.17 / 283.04 ±2.78 / 286.73 ms │     no change │
│ QQuery 76 │        132.44 / 134.92 ±1.62 / 137.20 ms │        137.01 / 138.62 ±1.04 / 140.12 ms │     no change │
│ QQuery 77 │        190.27 / 192.17 ±1.34 / 193.97 ms │        190.08 / 192.44 ±1.52 / 194.57 ms │     no change │
│ QQuery 78 │        353.63 / 355.91 ±2.49 / 360.57 ms │        364.43 / 367.87 ±1.94 / 370.14 ms │     no change │
│ QQuery 79 │        243.33 / 245.86 ±2.83 / 251.30 ms │        245.67 / 247.46 ±1.34 / 249.76 ms │     no change │
│ QQuery 80 │        331.13 / 332.78 ±1.63 / 335.57 ms │        333.68 / 337.01 ±3.40 / 343.47 ms │     no change │
│ QQuery 81 │           26.88 / 27.84 ±0.83 / 29.23 ms │           27.52 / 28.40 ±0.98 / 30.25 ms │     no change │
│ QQuery 82 │        201.66 / 205.03 ±2.67 / 209.48 ms │        204.47 / 208.55 ±3.24 / 214.33 ms │     no change │
│ QQuery 83 │           41.04 / 42.07 ±1.03 / 43.75 ms │           40.61 / 43.99 ±3.07 / 48.80 ms │     no change │
│ QQuery 84 │           49.39 / 49.92 ±0.66 / 51.00 ms │           50.05 / 50.54 ±0.55 / 51.55 ms │     no change │
│ QQuery 85 │        151.96 / 153.22 ±0.96 / 154.41 ms │        153.78 / 156.01 ±2.14 / 158.63 ms │     no change │
│ QQuery 86 │           39.99 / 41.20 ±0.98 / 42.83 ms │           39.69 / 41.06 ±0.70 / 41.56 ms │     no change │
│ QQuery 87 │           86.95 / 90.35 ±3.32 / 96.68 ms │           88.05 / 91.10 ±3.88 / 98.54 ms │     no change │
│ QQuery 88 │         99.67 / 100.64 ±1.01 / 102.22 ms │        100.42 / 101.35 ±0.88 / 102.82 ms │     no change │
│ QQuery 89 │        118.85 / 120.59 ±1.09 / 122.29 ms │        118.23 / 120.63 ±1.32 / 121.66 ms │     no change │
│ QQuery 90 │           23.78 / 24.48 ±0.54 / 25.26 ms │           23.61 / 24.33 ±0.54 / 25.06 ms │     no change │
│ QQuery 91 │           62.22 / 65.57 ±1.88 / 67.52 ms │           63.49 / 65.83 ±2.04 / 69.57 ms │     no change │
│ QQuery 92 │           58.61 / 59.61 ±1.07 / 61.58 ms │           58.04 / 59.19 ±0.96 / 60.61 ms │     no change │
│ QQuery 93 │        191.46 / 194.03 ±3.30 / 200.36 ms │        192.85 / 196.85 ±2.10 / 198.77 ms │     no change │
│ QQuery 94 │           62.14 / 63.07 ±0.53 / 63.59 ms │           61.46 / 62.79 ±0.81 / 63.68 ms │     no change │
│ QQuery 95 │        134.59 / 136.03 ±0.75 / 136.59 ms │        133.37 / 136.33 ±1.64 / 137.80 ms │     no change │
│ QQuery 96 │           71.09 / 74.05 ±1.52 / 75.29 ms │           70.39 / 73.82 ±1.74 / 75.05 ms │     no change │
│ QQuery 97 │        130.88 / 132.59 ±2.00 / 135.84 ms │        132.22 / 134.41 ±1.25 / 136.03 ms │     no change │
│ QQuery 98 │        152.99 / 155.38 ±1.72 / 158.09 ms │        155.66 / 157.87 ±1.36 / 159.58 ms │     no change │
│ QQuery 99 │ 10803.43 / 10839.96 ±32.53 / 10896.54 ms │ 10763.23 / 10828.29 ±40.94 / 10875.66 ms │     no change │
└───────────┴──────────────────────────────────────────┴──────────────────────────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                        ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                        │ 34267.84ms │
│ Total Time (alamb_update_arrow_58.1.0)   │ 34284.04ms │
│ Average Time (HEAD)                      │   346.14ms │
│ Average Time (alamb_update_arrow_58.1.0) │   346.30ms │
│ Queries Faster                           │          3 │
│ Queries Slower                           │          0 │
│ Queries with No Change                   │         96 │
│ Queries with Failure                     │          0 │
└──────────────────────────────────────────┴────────────┘

Resource Usage

tpcds — base (merge-base)

Metric	Value
Wall time	171.7s
Peak memory	5.4 GiB
Avg memory	4.4 GiB
CPU user	275.3s
CPU sys	19.1s
Disk read	0 B
Disk write	642.3 MiB

tpcds — branch

Metric	Value
Wall time	171.8s
Peak memory	5.8 GiB
Avg memory	4.8 GiB
CPU user	275.9s
CPU sys	18.6s
Disk read	0 B
Disk write	892.0 KiB

….1.0

adriangbot · 2026-03-24T20:50:56Z

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and alamb_update_arrow_58.1.0
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃                                  HEAD ┃             alamb_update_arrow_58.1.0 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0  │          1.34 / 4.72 ±6.59 / 17.89 ms │          1.32 / 4.63 ±6.46 / 17.55 ms │     no change │
│ QQuery 1  │        14.45 / 14.98 ±0.27 / 15.17 ms │        14.25 / 14.79 ±0.35 / 15.30 ms │     no change │
│ QQuery 2  │        55.82 / 56.17 ±0.21 / 56.46 ms │        45.47 / 45.86 ±0.31 / 46.26 ms │ +1.22x faster │
│ QQuery 3  │        51.03 / 51.61 ±0.71 / 52.94 ms │        43.90 / 45.75 ±1.10 / 46.75 ms │ +1.13x faster │
│ QQuery 4  │     298.00 / 307.20 ±7.69 / 317.67 ms │     314.81 / 323.98 ±7.03 / 334.66 ms │  1.05x slower │
│ QQuery 5  │     347.64 / 354.05 ±5.28 / 362.39 ms │     346.44 / 351.65 ±5.00 / 358.41 ms │     no change │
│ QQuery 6  │           5.21 / 5.73 ±0.63 / 6.90 ms │          6.33 / 8.02 ±2.07 / 11.74 ms │  1.40x slower │
│ QQuery 7  │        16.89 / 17.94 ±1.12 / 20.04 ms │        17.23 / 17.88 ±0.83 / 19.50 ms │     no change │
│ QQuery 8  │    419.78 / 435.78 ±12.14 / 451.41 ms │     447.95 / 458.96 ±9.52 / 470.60 ms │  1.05x slower │
│ QQuery 9  │    669.25 / 683.73 ±13.73 / 709.16 ms │    636.16 / 673.39 ±26.74 / 701.34 ms │     no change │
│ QQuery 10 │       93.82 / 96.80 ±3.72 / 104.06 ms │        91.09 / 94.36 ±2.77 / 98.21 ms │     no change │
│ QQuery 11 │     104.56 / 105.23 ±0.36 / 105.63 ms │     104.36 / 105.82 ±1.29 / 108.15 ms │     no change │
│ QQuery 12 │     346.82 / 355.44 ±6.29 / 363.84 ms │     346.20 / 354.62 ±6.76 / 364.46 ms │     no change │
│ QQuery 13 │     464.61 / 470.19 ±6.43 / 482.60 ms │    449.84 / 466.19 ±11.85 / 482.54 ms │     no change │
│ QQuery 14 │     350.68 / 356.84 ±5.57 / 365.76 ms │     373.46 / 379.96 ±3.76 / 384.20 ms │  1.06x slower │
│ QQuery 15 │    358.37 / 373.60 ±14.64 / 398.72 ms │    376.60 / 408.70 ±23.14 / 441.25 ms │  1.09x slower │
│ QQuery 16 │    749.77 / 771.98 ±27.41 / 825.31 ms │    731.88 / 754.30 ±23.58 / 799.81 ms │     no change │
│ QQuery 17 │    729.99 / 782.22 ±50.24 / 870.59 ms │    721.73 / 746.95 ±30.68 / 805.91 ms │     no change │
│ QQuery 18 │ 1440.87 / 1518.23 ±43.52 / 1572.35 ms │ 1399.55 / 1485.10 ±62.31 / 1557.13 ms │     no change │
│ QQuery 19 │       37.23 / 49.44 ±23.49 / 96.42 ms │        36.22 / 37.26 ±0.79 / 38.40 ms │ +1.33x faster │
│ QQuery 20 │    713.53 / 737.61 ±25.63 / 774.78 ms │     718.42 / 723.28 ±5.56 / 732.88 ms │     no change │
│ QQuery 21 │     757.36 / 760.77 ±2.70 / 764.70 ms │     759.71 / 768.62 ±6.43 / 778.62 ms │     no change │
│ QQuery 22 │  1126.56 / 1136.75 ±6.54 / 1147.10 ms │  1137.20 / 1143.10 ±6.67 / 1155.16 ms │     no change │
│ QQuery 23 │ 3093.71 / 3131.53 ±28.74 / 3177.95 ms │ 3107.41 / 3128.35 ±21.73 / 3159.53 ms │     no change │
│ QQuery 24 │      98.12 / 101.07 ±2.20 / 104.15 ms │      97.23 / 101.15 ±2.76 / 104.77 ms │     no change │
│ QQuery 25 │     138.94 / 140.55 ±2.14 / 144.72 ms │     138.71 / 142.14 ±2.11 / 145.14 ms │     no change │
│ QQuery 26 │      99.85 / 104.08 ±3.43 / 109.53 ms │     101.27 / 104.03 ±2.15 / 106.46 ms │     no change │
│ QQuery 27 │     849.99 / 856.93 ±3.82 / 861.45 ms │     848.53 / 859.89 ±7.49 / 871.52 ms │     no change │
│ QQuery 28 │ 7727.99 / 7785.60 ±33.21 / 7820.17 ms │ 7761.74 / 7804.12 ±48.21 / 7873.48 ms │     no change │
│ QQuery 29 │        55.75 / 60.46 ±5.02 / 67.11 ms │        51.82 / 56.71 ±3.10 / 61.56 ms │ +1.07x faster │
│ QQuery 30 │    364.30 / 386.28 ±12.26 / 400.27 ms │     371.32 / 380.75 ±6.31 / 390.41 ms │     no change │
│ QQuery 31 │     376.91 / 388.98 ±8.53 / 402.55 ms │    368.04 / 379.56 ±11.51 / 397.57 ms │     no change │
│ QQuery 32 │ 1072.23 / 1098.07 ±14.46 / 1114.79 ms │ 1047.87 / 1061.96 ±18.58 / 1097.15 ms │     no change │
│ QQuery 33 │ 1471.39 / 1505.98 ±38.99 / 1569.28 ms │ 1467.13 / 1512.19 ±36.60 / 1575.39 ms │     no change │
│ QQuery 34 │ 1482.96 / 1511.28 ±37.92 / 1584.62 ms │ 1535.26 / 1599.34 ±77.97 / 1745.44 ms │  1.06x slower │
│ QQuery 35 │    388.94 / 402.51 ±12.79 / 423.07 ms │    382.05 / 406.03 ±20.79 / 434.10 ms │     no change │
│ QQuery 36 │     112.05 / 122.64 ±6.69 / 129.75 ms │     117.96 / 121.35 ±2.09 / 123.42 ms │     no change │
│ QQuery 37 │        48.79 / 50.35 ±1.20 / 51.90 ms │        47.45 / 48.90 ±1.15 / 50.75 ms │     no change │
│ QQuery 38 │        74.85 / 78.10 ±1.65 / 79.36 ms │        76.40 / 77.18 ±1.14 / 79.44 ms │     no change │
│ QQuery 39 │     211.13 / 220.59 ±8.29 / 235.75 ms │     200.97 / 212.47 ±8.86 / 221.08 ms │     no change │
│ QQuery 40 │        22.82 / 24.63 ±2.04 / 28.34 ms │        22.86 / 27.38 ±3.71 / 31.79 ms │  1.11x slower │
│ QQuery 41 │        20.89 / 22.64 ±1.36 / 24.51 ms │        20.00 / 21.00 ±0.74 / 22.19 ms │ +1.08x faster │
│ QQuery 42 │        18.85 / 19.61 ±0.39 / 19.95 ms │        18.68 / 19.47 ±0.48 / 20.09 ms │     no change │
└───────────┴───────────────────────────────────────┴───────────────────────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                        ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                        │ 27458.91ms │
│ Total Time (alamb_update_arrow_58.1.0)   │ 27477.16ms │
│ Average Time (HEAD)                      │   638.58ms │
│ Average Time (alamb_update_arrow_58.1.0) │   639.00ms │
│ Queries Faster                           │          5 │
│ Queries Slower                           │          7 │
│ Queries with No Change                   │         31 │
│ Queries with Failure                     │          0 │
└──────────────────────────────────────────┴────────────┘

Resource Usage

clickbench_partitioned — base (merge-base)

Metric	Value
Wall time	138.4s
Peak memory	39.7 GiB
Avg memory	32.7 GiB
CPU user	1303.1s
CPU sys	93.7s
Disk read	0 B
Disk write	3.0 GiB

clickbench_partitioned — branch

Metric	Value
Wall time	138.5s
Peak memory	40.5 GiB
Avg memory	33.2 GiB
CPU user	1301.1s
CPU sys	95.0s
Disk read	0 B
Disk write	820.0 KiB

alamb · 2026-03-25T09:46:27Z

🚀

alamb force-pushed the alamb/update_arrow_58.1.0 branch from 08c6bd7 to 0913120 Compare March 18, 2026 21:13

This comment was marked as outdated.

Sign in to view

This comment has been minimized.

Sign in to view

alamb changed the title ~~Update to arrow/parquet 58.1.0~~ Update to arrow/parquet 58.1.0 Mar 19, 2026

martin-g marked this pull request as draft March 19, 2026 14:33

alamb mentioned this pull request Mar 20, 2026

Release arrow-rs / parquet Minor version 58.1.0 (March 2026) apache/arrow-rs#9108

Closed

7 tasks

Update to arrow/parquet 58.1.0

93e0202

alamb force-pushed the alamb/update_arrow_58.1.0 branch from 14c9e83 to 93e0202 Compare March 24, 2026 20:24

alamb marked this pull request as ready for review March 24, 2026 20:26

This was referenced Mar 24, 2026

Debug assertions currently failing on main #20831

Closed

sqllogictests fail in debug mode (join_full_multi_batch::batch_size_4_2) #20689

Closed

feat: add support for parquet content defined chunking options #21110

Open

mbutrovich approved these changes Mar 24, 2026

View reviewed changes

stuhood mentioned this pull request Mar 24, 2026

debug assertions for ci-optimized #21085

Draft

alamb added 2 commits March 24, 2026 16:50

Merge remote-tracking branch 'apache/main' into alamb/update_arrow_58…

9f735c6

….1.0

Fix cargo.lock

5825dbf

Fix lock

9c6917d

alamb added this pull request to the merge queue Mar 25, 2026

Merged via the queue into apache:main with commit a074902 Mar 25, 2026
33 checks passed

alamb deleted the alamb/update_arrow_58.1.0 branch March 25, 2026 09:46

stuhood mentioned this pull request Mar 25, 2026

Enable debug assertions in CI. #20832

Merged

Conversation

alamb commented Mar 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Which issue does this PR close?

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Uh oh!

This comment was marked as outdated.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

alamb commented Mar 24, 2026

Uh oh!

adriangbot commented Mar 24, 2026

Uh oh!

adriangbot commented Mar 24, 2026

Uh oh!

adriangbot commented Mar 24, 2026

Uh oh!

adriangbot commented Mar 24, 2026

Uh oh!

mbutrovich left a comment

Choose a reason for hiding this comment

Uh oh!

adriangbot commented Mar 24, 2026

Uh oh!

adriangbot commented Mar 24, 2026

Uh oh!

alamb commented Mar 25, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

alamb commented Mar 18, 2026 •

edited

Loading